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Large  Deviations  for  the  Maxima  of  Some  Random  Fields 

by 

M.  L.  Hogan  *  and  D.  Siegmund  f 
Columbia  University  and  Stanford  University 
Dedicated  to  Herbert  Robbins  on  the  occasion  of  his  70th  birthday 

Several  statistical  problems  which  involve  the  distribution  of  the  maximum  of  Gaus* 
sian  random  fields  are  described.  Specific  examples  are  the  pinned  Brownian  sheet  and 
a  Brownian  bridge  with  “reflection,”  which  arises  in  certain  change  point  problems.  In 
these  concrete  cases  the  method  of  Pickands  (1969,  Traas.  Amcr.  Math.  Soc.)  is  adapted 
to  give  large  deviation  probabilities  for  the  maximum,  both  for  continuous  and  for  discrete 
indexing  sets.  A  different  method  is  used  to  give  a  second  order  correction  for  the  reflected 
Brownian  bridge  and  hence  for  reflected  Brownian  motion.  The  numerical  accuracy  of  the 
approximations  b  studied  via  simulation. 


1.  Introduction  and  Snmmary. 


A  random  field  is  a  stochastic  process  indexed  by  a  more  than  one  dimensional  set, 
typically  a  subset  of  the  n  dimensional  integer  lattice  or  n  dimensional  Euclidean  space. 
We  shall  call  such  a  process  an  n  dimensional  random  field.  Since  the  random  variables 
themselves  assume  real  values,  no  confusion  should  result  from  this  terminology.  For  the 
most  part  we  consider  only  the  case  n  =  2,  but  some  of  our  methods  are  valid  more  generally. 

We  wish  to  discuss  some  examples  of  random  fields  arising  in  statistics.  The  statis¬ 
tical  questions  give  rise  to  probability  questions  about  the  random  fields,  among  which  is 
determining  the  distribution  of  the  maximum  of  the  field  over  some  subset  of  its  indexing 
set.  We  deal  with  fields  which  are  closely  related  to  simple  one  dimensional  processes  such 
as  random  walk.  Brownian  motion,  and  Brownian  bridge.  There  are  many  techniques  for 
deriving  exact  results  about  the  maximum  of  these  one  dimensional  processes,  mainly  based 
on  the  strong  Markov  property  and  the  relation  of  the  time  at  which  the  process  first  ex¬ 
ceeds  a  level  (first  passage  time)  and  the  maximum  of  the  process.  For  higher  dimensional 
random  fields  there  is  no  natural  linear  ordering  of  the  indexing  set.  Consequently  there  are 
no  first  passage  times,  and  the  techniques  that  give  exact  results  for  one  dimension  work 
only  approximately  or  not  at  all  in  more  than  one. 

On  the  other  hand  there  are  methods  for  approximating  the  tail  of  the  distribution 
of  the  maximum,  which  are  not  intrinsically  one  dimensional.  These  have  been  developed 
mainly  in  the  context  of  Gaussian  random  fields,  especially  by  Pickands  [13],  Bickel  and 
Rosenblatt  [4],  and  Qualls  and  Watanabe  [14].  The  techniques  can  be  broken  into  two 
parts.  The  first  is  to  observe  that  the  contribution  to  the  probability  of  ever  crossing  a  high 
level  comes  from  a  small  neighborhood  of  the  subset  of  the  indexing  set  where  the  marginsJ 
probability  of  being  above  the  level  is  greatest.  Second,  when  this  subset  is  not  a  single 
point,  it  can  be  broken  into  small  pieces  which  contribute  approximately  disjointly  to  the 
total  probability,  which  consequently  can  be  obtained  by  adding  together  the  contributions 
of  each  small  piece.  The  method  does  not  in  general  give  explicit  results,  and  in  fact  does 
so  only  rarely  in  the  papers  quoted  above.  For  the  problems  in  which  we  are  interested,  it 
does  give  explicit  asymptotic  approximations  for  the  tail  probability  of  the  distribution  of 


the  maximum. 

Since  our  interest  in  these  approximations  arises  because  of  their  relations  to  certain 
statistical  problems,  these  problems  provide  criteria  for  judging  whether  the  approximations 
are  adequate  or  not.  Usually  the  probabilities  can  be  interpreted  as  the  significance  levels  of 
statistical  tests,  so  it  is  important  that  they  be  accurate  when  the  true  probabilities  are  in 
the  range  .Ol-.IO.  We  discuss  later  how  accurately  the  asymptotic  expressions  approximate 
the  actual  distribution. 

We  begin  by  describing  two  statistical  problems  that  lead  to  random  fields:  the  em¬ 
pirical  distribution  in  more  than  one  dimension  and  certain  change  point  problems.  In 
each  case  we  consider  in  some  detail  two  random  fields,  one  of  which  is  common  to  both 
problems. 

Suppose  that  Xi,  X2,  ■  ■  ■  are  independently  and  identically  distributed  with  a  contin¬ 
uous  distribution  function  F.  Let 

<sl 

be  the  empirical  distribution  function  and 

the  empirical  process.  The  change  of  variables  g  =  F(z)  converts  this  to 

D„(z)  =  -  z], 


where 

ft 

f=i 

The  random  variables  F{Xi)  are  independently  and  uniformly  distributed  on  (0, 1),  so  the 
distribution  of  D„(z)  does  not  depend  on  F.  It  is  well  known  that  the  limiting  distribution  of 
f7n(z)  is  that  of  a  Brownian  bridge  on  [0, 1]  (cf.  [5],  Section  13.6).  The  Kolmogorov-Smimov 
statistic  is 

8up(F„(z)  -  F(x)l  =  sup  D„[z). 

a  0<f<l 
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Thus  the  distribution  of  the  KolmogoroT-Smimor  statistic  does  not  depend  on  the  under* 
lying  distribution  function  F,  and  its  limiting  distribution  is  that  of  the  maximum  of  a 
Brownian  bridge. 

Now  suppose  that  we  have  independent,  identically  distributed  bivariate  observations 
{Xi,  Yi)  with  distribution  function  G{x,  y).  Assume  that  Xi  and  Yi  have  continuous  marginal 
distribution  functions  Fi  and  F2  respectively.  The  empirical  distribution  function  of  the 
first  n  observations  is 


Gn{x,  y)  —  f*  *  1(— oe,*lx(-oo,fl(-^t !  Yi). 

t=l 


Set 

Dn{x,  y)  =  y)  -  G{x,  y)]  -  00  <  *,  y  <  00. 

With  the  change  of  variables  z  =  Fi(z),  w  =  Fziy),  Dn  transforms  to  a  process  on  the  unit 
square 

Dn{z,w)  =  -  G(Fr»(z),Ff  *(«))), 


where 

n 

Un{z,  V>)  = 

t=l 

The  Kolmogorov-Smimov  statistic  is 


!»*/’  8up[G„(z,  y)  -  G{x,  y)l  =  sup  D„(z,  w). 

».»  *»• 

The  random  field  £?„(z,v;)  converges  to  a  limiting  Gaussian  random  field  fYo(z,w)  on  the 
unit  square,  but  unlike  the  one  dimensional  case  the  covariance  function  of  the  random  field 
depends  on  the  underlying  distribution  G.  The  special  case  that  Xi  and  Yi  are  independent 
is  particularly  important.  Then  the  covariance  function  is  JC[(zi,t0i),(s2,t02)l  =  (^t  ^ 
Z3)(iOi  A  t02)(l  -  zi  V Z2)(l  -  wi  V  Wi).  This  random  field,  the  pinned  Brownian  sheet,  stands 
in  the  same  relation  to  another  random  field,  the  Brownian  sheet,  as  the  Brownian  bridge 
does  to  Brownian  motion  in  one  dimension.  The  question  suggested  by  the  Kolmogorov* 
Smirnov  statistics  is  to  compute  the  distribution  of  the  maximum  of  the  pinned  Brownian 
sheet. 


In  Section  2  we  rstablish 


Theorem  1.  As  u  -*  oo 


P{8Upiyo(*»w)  >  «}  ~  4log2  u*exp(-2u*).  (1.1) 

Goodman  [8]  showed  that  the  probabiity  on  the  left  hand  side  of  (1.1)  exceeds  (2u^  + 
l)exp(-2u^).  An  upper  bound  is  given  in  [6]. 

Since  the  distribution  of  the  two  dimensional  Kolmogorov-Smimov  statistic  depends 
on  the  imderlying  distribution  G,  Adler  and  Brown  [1]  raise  the  question  of  finding 

8upP{8upD„(z,«)  >  u}, 

a  »,• 

and  show  that  in  the  asymptotic  limit  (n  — »  oo)  the  supremum  is  attained  by  a  two  dimen¬ 
sional  distribution  G  which  is  uniform  on  the  off-diagonal,  z+w  =  1.  Moreover,  the  limiting 
value  of  this  supremum  has  the  following  representation  in  terms  of  the  one  dimensional 
Brownian  bridge,  Wo{i),  0  <  t  <  1: 

P{  sup  [Wo(t)-Wo(s)]>ul  (1.2) 

0<»<I<1 

A  slightly  more  general  quantity  than  (1.2)  arises  in  a  class  of  change  point  problems,  which 
we  discuss  next. 

As  a  second  example  we  consider  a  class  of  change  point  problems,  more  or  less  as 
formulated  by  Levin  smd  Kline  [12].  Let  AT,-,  »  =  1,2, *••,!»  be  independent,  normally 
distributed  random  variables  with  means  m  and  variance  1.  Consider  the  problem  of  testing 

ffo  :  Ml  =  =  •  •  •  =  Mu*  (=  Mo) 

against 

Hi  31  <  Pi  <  P2  <  m,  iti  =  ■  •  =  =  po, 

Mr»+i  =  ••  •  =  Mrt  =  Mo  +  #,  Mw+i  =  '  •  •  =  Mm  =  Mo- 
The  alternative  hypothesis  Hi  has  been  called  a  square- wave  or  epidemic  alternative  because 

an  epidemic  runs  from  time  pi  through  p2  after  which  the  baseline  rate  mo  is  restored.  It 
may  be  compared  to  the  more  common  hypothesis  of  a  single  change  point  where,  in  effect, 

P2  =  m. 
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If  it  is  assumed  that  /xo  and  S  are  known,  the  log  likelihood  ratio  statistic  for  testing 
H(t  against  Hi  is  given  hj 

Zi  =  6  ir.M  [5y  -  j/to  -  (Si  -  ino)  -  (j  -  i)6/2] 

0<t<j<m 

=  maxfSj  -  inf  5;), 
y<m  i^' 

where  Si  =  ^{5,-  —  t(/io  +  ^/2)1- 

When  yio  is  unknown  one  possible  course,  suggested  by  Levin  and  IQine  [12],  is  to 
replace  no  by  its  estimate  under  Ha,  S^jm,  which  leads  to  the  test  statistic 

^2  =  ^  max  \Sj- i  Smlm-(Si- Snlm)-(3-i)8l2].  (1.4) 

Levin  and  Kline  are  interested  in  Bernoulli  and  Poisson  random  variables  rather  than  nor¬ 
mal.  Since  /iq  is  a  nuisance  parameter,  they  suggest  that  the  distribution  of  should  be 
calculated  conditional  on  5nt.  The  conditional  and  unconditional  distributions  of  Z2  are 
the  same  in  the  normal  case,  but  in  general  this  adds  another  feature  to  the  problem. 

Alternatively,  the  actual  likelihood  ratio  statistic  may  be  computed  by  maximizing  the 
log  likelihood  over  /io,  pi,  and  p2-  This  gives 

Z2  =  6  max  [5y  -  5,-  -  (j  -  »)5„/m  -  U(j  -  t)(l  -  (3  -  i)/m)].  (1.5) 

When  6  is  also  not  known  one  might  use  either  Z2  or  Z3  based  on  some  value  60,  the 
smallest  difference  in  means  which  is  considered  important  to  detect,  or  proceed  to  the  full 
log  likelihood  ratio  statistic  by  maximizing  (1.5)  over  S,  obtaining 

~  ~  *)5m/m]+/[(y  -  0(1  -  "»“‘(J  -  0)1^^^}. 

0<t<f<m 

where  =  max(2, 0). 

Each  of  these  statistics  is  the  maximum  of  a  Gaussian  random  field  defined  on  {(t,  j) : 
0  <  «,y  <  m}.  It  is  interesting  to  compare  the  third  expression  for  Zt  given  in  (1.3)  to  what 
would  be  obtained  under  the  simpler  alternative  hypothesis  of  exactly  one  change  point. 
This  is  tantamount  to  setting  p2  =  mva.  Hi,  which  leads  in  the  case  of  known  /xo  a&d  S  to 
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the  log  likelihood  ratio  statistic 


Zi  =  max[Sm  -  5,) 

t<m 

=  5m  -  min  5,-. 

•<m 

This  random  variable  czm  be  shown  by  means  of  time  reversal  to  have  the  same  distribution 
as  max(0, 5i,---,5m)  ([7],  p.  198),  and  consequently  the  distribution  of  is  determined 
by  solving  a  first  passage  problem  for  the  random  walk  5,-.  However,  the  time  reversal 
technique  applied  to  Zi  leaves  it  basically  unchanged.  In  addition,  first  passage  problems 
for  ordinary  random  walk  are  analytically  tractable  because  the  value  of  the  random  walk 
at  the  time  of  first  passage  is  rather  well  determined.  (For  Brownian  motion  it  would  be 
known  exactly.)  In  principle  the  problem  of  computing  the  distribution  of  Zi  is  equivalent 
to  a  first  passage  problem  for  the  “reflecting”  barrier  process 

Wf  =  Sf  —  1^  Si, 

in  the  sense  that  P{Zi  >  u}  =  P{T  <  m},  where  T  =  min{y  :  PKy  >  u}.  The  fact 
that  the  value  of  St  is  not  known,  even  approximately,  makes  this  problem  substantially 
more  difficult  than  the  corresponding  passage  problem  for  Si.  (The  distribution  of  St  has 
been  studied  in  [18],  at  least  in  continuous  time,  but  this  does  not  seem  to  help  us  here.) 
Nevertheless,  the  observation  that  (1.3)  and  (1.4)  can  be  formulated  as  one  dimensional 
problems  is  very  useful.  See  Theorem  3  below  and  its  proof  in  Section  3.  There  does  not 
seem  to  be  any  corresponding  transformation  of  (1.5)  to  a  one  dimensional  problem. 

In  order  to  state  the  following  results  it  is  convenient  to  let  lF((t)  denote  one  dimen¬ 
sional  Brownian  motion  conditioned  to  equal  (  at  time  t  =  m.  Then  Ze  =  maxo<i<,n|l^((0~ 
(t^((s)]  is  essentially  a  continuous  version  of  Z2  defined  in  (1.4).  In  Section  3  we  prove 

Theorem  2.  Suppose  u  =  mf  and  ^  =  m(o  for  some  ?  >  0  and  fo  <  ?•  Then  as  m  -♦  00 

>  «}  =  »^^l2(2f-fo)]l2(2u-f)(«-0/»»+o(”»)]e*p[-2u(u-f)/mj, 

(1.6) 

where  v{  )  is  defined  in  (3.2),  and  i,j  are  restricted  to  be  integers. 
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Theorem  S.  With  the  same  asymptotic  nonnaiization 

P{  mM  [jy((t)  -  W{(«)|  >  u}  =  [2(2u  -  f)(u  -  £)/fn  +  1  +  o(l)]  exp[-2u(u  -  OM-  (1-7) 

Theorem  2  was  stated  and  Theorem  3  conjectured  in  [16].  Related  statistics  are  dis¬ 
cussed  in  [3]. 

Theorem  2  is  a  sampled  version  of  Theorem  3.  The  two  approximations  differ  in  the 
leading  term  by  the  factor  i/*[2(2f  -  fo)]i  which  occurs  because  of  the  discrete  indexing  set 
in  Theorem  2.  For  computational  purposes  it  usually  suffices  to  use  the  approximation 

v{x)  =exp{-px)-i-o{x^)  {*-»0),  (1.8) 

where  ^  is  a  numerical  constant  approximately  equal  to  0.583  ([17],  X.2).  Typically  the  value 
of  1/^  is  in  the  range  .2  to  .5,  so  failure  to  account  for  the  discreteness  usually  overestimates 
the  true  probabiity  by  a  considerable  amount.  Theorem  3  contains  a  higher  order  term  in 
an  asymptotic  expansion  of  the  tail  probability  for  that  process. 

If  the  max  in  Theorem  3  were  taken  over  all  «  #  t,  instead  of  «  <  t,  it  would  be  easy 
to  calculate  the  probability  exactly.  For  example, 

P{  m«  [Wf(t)  -  W((«)]  >  u}  (1.9) 

$^t<m 

00 

{m~^[2n(2f»u  -  f)(u  -  ^)  exp[-2nu(nu  —  0/”*I  ~  (2"  +  1)  exp[-2nu(n«  +  ^)/m]. 

00 

n^O 

For  the  special  case  ^  =  0  this  becomes 

00 

P{  max  [Wo(t)  -  Wo(s)]  >  u}  =  y^(8r»’u*/m-  2)exp(-2r»*u*/m).  (1-10) 

From  considerations  of  symmetry,  it  appears  that  the  probability  in  (1.7)  in  the  case  ^  =  0 
should  be  about  1/2  that  in  (1.10).  This  heuristic  is  asymptotically  correct  at  the  first  order 
term,  but  not  the  second.  It  may  be  possible  to  evaluate  the  probability  in  (1.7)  exactly, 
but  we  have  no  idea  how  to  do  it. 

By  integrating  out  (  one  obtains  from  Theorems  2  and  3  analogotis  results  for  uncon¬ 
ditional  processes.  For  example  we  have, 
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Corollary  to  Theorem  S.  Let  W{t),  0  <  t  <  oo,  be  standard  Brownian  motion  and 
fi  >  0.  Suppose  m  —*  oo  and  u  — ►  oo  such  that  is  some  fixed  number  in  (l,oo). 

Then 

P{  mia  [iy(f)  -  FK(«)  -  n{t  -  «)]  >  u}  =  [2n(mfi  -  u)  +  3  +  o(l)]exp(-2/*u). 

Proofs  of  Theorems  1,  2,  and  3  are  given  in  Sections  2,  3,  and  4  respectively.  A 
numerical  example  illustrating  the  accuracy  of  the  approximation  of  Theorem  2  appears  in 
Section  5,  which  also  contains  a  heuristic  attempt  to  adapt  the  expansion  (1.7)  for  use  with 
a  discrete  indexing  set. 

2.  Proof  of  Theorem  1. 

In  this  section  we  use  Pickands’  [13]  method  to  prove  Theorem  1.  The  method  was 
also  applied  to  random  field  problems  in  [4]  and  [14].  Our  exposition  follows  closely  that 
given  in  [11],  Chapter  12,  in  the  one  dimensional  case.  Large  parts  of  the  proofs  carry 
over  almost  word  for  word,  but  with  two  novel  feattires.  All  of  the  authors  above  were 
interested  in  stationary  fields  or  processes  in  which  the  random  variables  corresponding 
to  each  point  in  the  indexing  set  contribute  equally  to  the  maximum.  Our  processes  are 
nonstationary,  and  asymptotically  the  only  contribution  comes  from  a  neighborhood  of 
that  subset  of  the  index  set  where  the  marginal  probability  of  being  above  a  high  level  is 
a  maximum.  For  the  present  case  of  the  pinned  Brownian  sheet,  Wo(9,t)  is  a  zero  mean 
Gaxissian  variable.  Therefore,  F{lPo(«,  t)  >  u}  is  maximized  at  those  values  of  »,t  which 
maximize  E[Wg{s,  t)]  =  «t(l  -  st).  This  set  is  the  section  of  the  hyperbola  st  =  1/2  lying  in 
the  unit  square.  Technically  this  means  that  the  major  contribution  to  certain  sums  comes 
from  a  neighborhood  of  the  critical  set,  resulting  in  delta-functon  like  approximations.  Every 
argtunent  in  [11]  must  be  modified  to  take  this  fact  into  account,  but  it  is  straightforward 
to  do  so.  One  example  of  the  necessary  changes  is  given  in  Lemma  3,  but  most,  along  with 
most  detailed  proofs,  are  omitted. 

Secondly,  the  general  expressions  for  the  tail  of  the  maximum  of  Gaussian  random 
fields  involve  a  constant  given  in  terms  of  a  complicated  functional  of  the  maximum  of  a 
related  process,  which  can  be  shown  to  be  positive  and  finite,  but  otherwise  is  not  obviously 
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tractable.  The  related  processes  which  occur  in  the  problems  we  discuss  are  simple  enough 
to  allow  explicit  evaluation  of  all  constants.  The  appearance  of  the  function  i/  in  Theorem 
2  because  of  the  discrete  indexing  set  is  a  particularly  interesting  example.  See  Lemma  3.4. 

The  proof  of  Theorem  1  is  given  as  a  series  of  lemmas,  the  proofe  of  which  are  mostly 
omitted  because  they  follow  closely  those  of  [11],  Chapter  12.  See  also  the  analogous  results 
of  Section  3  where  occasionally  more  detail  is  given. 

We  shall  use  the  notation 

p(x)  =  (2r)-‘/*exp^-^x^^,  Hx)  =  j  ifi(z)dz. 

Also,  for  any  random  variable  X,  P{X  €  dx)  denotes  the  measure  corresponding  to  the 
distribution  function  of  X.  In  particular  if  X  is  absolutely  continuotis  with  probability 
density  function  /,  then  P{X  €  dx}  =  f{x)dx.  We  write  X  ~  to  mean  P{X  < 

35}  =  *[(35  - 

For  the  rest  of  this  section  —  a.  Let  (u*((r,r)  =  u[Wo(s  —  q<T,  t  —  qr)  —  u]. 
Lemma  2.1.  Suppose  (T,r  >0.  Then 

r)  I  C'(0,0)  =  z)  =  X  -  s-^aa  -  t'^ar  +  0(q) 


and 

Cov(C'(<Ti,  rj),  C‘(<T2,  rj)  I  C‘(0,0)  =  x)  =  a(s(ri  A  rj)  +  t{<Ji  A  (t,)]  +  0(g), 

where  in  both  cases  0(g)  holds  uniformly  for  (<ti,  n.irj,  rj)  in  compact  sets  and  s,t  with  »t 
bounded  away  from  0. 

Proof.  A  straightforward  calculation  suffices. 

Remarks.  Since  the  conditional  distribution  is  normal  it  is  determined  by  its  mean  and 
covariance.  Furthermore,  as  u  — ♦  00  (hence  g  — *  0),  r)  converges  in  distribution  to  a 

process  having  a  very  simple  representation.  Let  Xi{(r)  and  X2(r)  be  independent  standard 
Wiener  processes.  It  is  easily  verified  by  checking  covariances  that  the  limiting  process  can 
be  represented  as 

(at)‘/*Xi((T)  -  a<T/«  +  (aa)’/*X2(r)  -  ar/t.  (2.1) 


9 


14.  Qualls,  C.  and  Watanabe,  H.  Asymptotic  properties  of  Gaussian  random  Helds,  Trans. 
Amer.  Math.  Soc.  ITT  (1973),  155-171. 

15.  Siegmund,  D.  Corrected  diffusion  approximations  in  certain  random  walk  problems, 
Adv.  AppL  Probab.  11  (1979),  701-719. 

16.  Siegmimd,  D.  Boundary  crossing  probabilities  and  statbtical  applications,  submitted 
to  Ann.  Statist.  (1985). 

17.  Siegmund,  D.  Sequential  Analysis:  Tests  and  Confidence  Intervals,  Springer- Verlag, 
New  York-Heidelberg- Berlin  (1985). 

18.  Taylor,  H.  A  stopped  Brownian  motion  formula,  Ann.  Probab.  S  (1975),  234-246. 

19.  Woodroofe,  M.  A  renewal  theorem  for  curved  botmdaries  and  moments  of  first  passage 
times,  Ann.  Probab.,  4  (1976),  67-80. 

20.  Woodroofe,  M.  Nonlinear  Renewal  Theory  in  Sequential  Analysis,  Society  for  Indus¬ 
trial  and  Applied  Mathematics,  Philadelphia  (1982). 


References 


1.  Adler,  R.  and  Brown,  L.  Tail  behavior  for  supreme  of  empirical  processes,  tmpublished 
manuscript  (1984). 

2.  Asmussen,  S.  Approximations  for  the  probability  of  ruin  in  finite  time,  Scand.  Actuarial 
J.  (1984),  31-57. 

3.  Bhattacharya,  P.  K.  and  Brockwell,  P.  J.  The  minimum  of  an  additive  process  with 
applications  to  signal  estimation  and  storage  theory,  Z.  Wabrsebein.  verw.  Geb.  37 
(1976),  51-75. 

4.  Bickel,  P.  and  Rosenblatt,  M.  Two-dimensional  random  fields,  in  Multivariate  Analyaia 
-  Ill,  P.  K.  Krishnaiah,  ed..  Academic  Press,  New  York  (1973),  3-15. 

5.  Breiman,  L.  Probability,  Addison  Wesley,  Reading,  Massachsusetts  (1968). 

6.  Cabana,  E.  and  Wschebor,  M.  The  two  parameter  Broxvnian  bridge,  Aon.  Probab.  10 
(1982),  289-302. 

7.  Feller,  W.  An  Introduction  to  Probability  Theory  and  Ita  Applications,  Vol.  II,  John 
Wiley  and  Sons,  New  York  (1972). 

8.  Goodman,  V.  Distribution  estimates  for  functionals  of  the  two  parameter  Wiener  pro¬ 
cess,  Ann.  Probab.  4  (1976),  977-982. 

9.  Hogan,  M.  “Problems  in  boundary  crossings  for  random  walks,”  Stanford  University 
dissertation  (1984). 

10.  Joag-Dev,  K.,  Perlman,  M.,  and  Pitt,  L.  Association  of  normal  random  variables  and 
Slepian’s  inequality,  Ann.  Probab.  11  (1983),  451-455. 

11.  Leadbetter,  M.,  Lindgren,  G.,  and  Rootzen,  H.  Extremes  and  Related  Properties 
of  Random  Sequences  and  Processes,  Springer- Verlag,  New  York-Heidelberg-Berlin 
(1983). 

12.  Levin,  B.  and  Kline,  J.  The  c\uum  test  of  homogeneity,  with  an  application  to  spon¬ 
taneous  abortion  epidemiology,  Columbia  University,  preprint  (1985). 

13.  Pickands,  J.  Uperossing  probabilities  for  stationary  Gaussian  processes,  Trans.  Amer. 
Math.  Soe.  145  (1969),  51-73. 


22 


Table  I 

Appraximations  to  P{mazo<t<y<m(^i  -  >  «  I 


Monte  Carlo  Theoretical 

u  m  (iV  =  1600)  (1.6)  Modified  (1.7) 


5.0 

100 

9.0 

100 

.030 

±  .004 

.024 

.0056  ±  .0019 

.0043 

.344 

±  .012 

.298 

.044 

±  .005 

.044 

.156 

±  .009 

.135 

.257 

±  .011 

.171 

.174 

±  .009 

.110 

.053 

±  .006 

.049 

.117 

±  .008 

.094 

±  .006 

.067 

.117 

±  .008 

.098 

2: 


2.  This  approximation  appears  to  be  moderately  good,  but  consistently  too  small.  It  is 
poor  for  f  >  0. 


L 


For  random  walk  first  passage  problems  there  exists  an  approximation  which  uses  a 
completely  different  normalization  than  the  large  deviation  normalization  considered  here, 
although  the  resulting  approximations  are  often  are  very  similar  [2,  9,  15,  17].  These  ap¬ 
proximations  often  have  the  interpretation  that  they  equal  the  analogous  Brownian  motion 
probability  corrected  for  discrete  time  and  (if  necessary)  for  nonnormality  of  the  random 
walk.  Moreover,  the  correction  for  discrete  time  b  simply  to  dbplace  the  first  passage  level 
u  by  the  average  amotint  that  the  dbcrete  time  process  jumps  over  the  boundary.  In  the 
Gaussian  case  thb  b  just  the  constant  ^  which  appears  in  (1.8).  See  [17]  for  a  more  detailed 
dbcussion  of  thb  approximation  and  a  comparison  with  large  deviation  approximations. 

For  random  walk  problems  with  refiecting  barriers,  it  b  clear  that  the  analogous  mod¬ 
ification  b  to  displace  the  first  passage  boundary  by  (cf.  [17],  Theorem  10.16).  If  one 
were  to  make  thb  modification  to  the  Brownian  motion  approximation  of  Theorem  3,  to  the 
extent  that  ^  i.8)  b  an  equality,  the  resulting  approximation  would  be  the  same  as  (1.6)  to 
first  order.  Now,  however,  there  are  higher  order  terms,  which  might  conceivably  improve 
the  approximation. 

The  third  entry  in  each  row  of  Table  I  gives  the  approximation  of  Theorem  3,  but 
with  u  replaced  by  u  -t-  1.166.  Thb  second  approximation  seems  to  be  slightly  better  in 
cases  where  both  approximations  are  good  and  substantially  better  when  (  >  0,  where  the 
approximation  from  Theorem  2  b  not  particularly  good. 

It  appears  to  be  a  very  complicated  task  to  find  a  genuine  second  order  approximation 
or  to  justify  the  one  suggested  here.  The  problem  becomes  even  more  diflicult  for  other 
Gaussian  fields,  e.g.  those  considered  in  Theorem  1  and  in  (1.6),  which  do  not  appear  to 
have  a  convenient  one  dimensional  representation. 
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t 


»»}.  To  obtain  an  appropriate  bound  for  the  first  term  let  be  defined  by 


W{<r^^)  = 


inf  W{a) 


and  observe  that 


{r(2)(u)  <  m}  C  0({r<*)(a)  <  n  <  r(2)(„)  <  «} 

nsl 

^  “)  ^  "“l- 

and  these  events  are  easily  analyzed  individually.  (Corollary  3  of  [10]  can  be  used  to  show 
that 

<  „  <  a(2)^  r(2)  <  m}  <  <  "»})*, 

or  a  somewhat  weaker  result  may  be  obtained  by  ‘^are  hands.”)  For  the  rest  of  the  series 
a  crude  but  more  than  adequate  bormd  is  a  consequence  of  the  following  inequalities:  for 
any  k, 


<  00}  <  mi  Pi”'{rP' 


<oo}  +  mif;pW{rl”‘-l<m) 

*sl 


and 

•nA 

pjm)|p(m*0  <  m}  <  Po,7*{W'(0  -  W{s)  >  u  for  some  (j  -  !)/*»  <  s  <  t  <  (j  +  !)*»}. 

1=1 


6.  Numerical  Ebcamples. 

In  this  section  we  report  the  result  of  a  Monte  Carlo  experiment  to  indicate  the  ac* 
curacy  of  the  approximations  obtained  in  the  preceding  sections.  As  mentioned  in  the 
introduction,  the  statistical  origins  of  these  problems,  where  they  arise  as  significance  lev* 
els  of  statistical  tests,  suggests  that  we  should  be  particularly  interested  in  cases  where  the 
probability  is  about  0.01  -  0.10.  (For  the  same  reason  we  are  more  interested  in  non  positive 
values  of  the  drift  parameter,  (.) 

For  selected  values  of  u,  m,  and  (  Table  1  gives  approximations  to  the  probability  in 
(1.6).  The  first  entry  is  a  Monte  Carlo  estimate  based  on  a  direct  frequency  count  from  a 
1600  trial  experiment.  The  second  entry  is  the  asymptotic  approximation  given  by  Theorem 


<»>-<-<.  n'(r)  =  X  +  (4.3) 

-  2(m  -  t)"^  (  “  0<xp[-2tu(»u+  *  -  0/(»n  -  «)].  *>f  -  « 

I  E^(2*«  +  f  -  *)  exp(-2tu(»u  +  f  -  z)/(m  -  t)l,  x  <  f  -  u. 

After  a  tedioua  argument  to  check  that  these  formal  substitutions,  especially  that 
coming  from  (4.3),  can  be  justified  by  the  dominated  convergence  theorem,  we  obtain  the 
upper  botmd 

lim  €  dx,  /,+,  €(«,«  +  e),T,+*  <  =  u  +  *}/{2|*|<fz/mt»/2(l  -  t/m)’/*} 

^  r  (x-jt/m)  1  f  ESi(2»«  +  X  -  f )  exp{-2tu(ttt  +  x  -  ()l(m  -  t)),  x>(-u 
[{t(l  -  J  I  X^^(2$  (  —  x)  exp(-2tu(«u  +  f  -  x)/(m  -  t)),  x  <  f  -  u  . 

An  exact  upper  bound  for  the  probability  of  interest  can  in  principle  be  obtained  by  using 
(4.4)  to  bound  (4.1).  A  lengthy  asymptotic  evaluation  of  the  resulting  multiple  integral 
yields  the  right  hand  side  of  (1.7). 

The  lower  bound  is  substantially  more  complicated,  and  we  briefly  outline  the  argu¬ 
ment.  Let  =  T  and  for  k  >  1  on  <  m}  let 


=  inf{t :  t  >  W(t)  -  inf  W(»)  >  u}. 

Then  by  Patou’s  lemma,  a  lower  bound  for  the  right  hand  side  of  (4.1)  is  the  upper  bound 
discussed  above  minus  the  limit  inferior  as  e  0  of 


j  j  <  t  <  e  dx,/  i+f  6  (t,t  -I-  <  m,  (4.5) 

W{f)  =  « -»-  x}dt  J  PqY {*  <  <  t  e}dt  +  S*"*  /  /  ^0,7^  ^ 

!•(*+»)  >  t  +  e,Ait+t  €  dx,/,+«  €(«,«-»-  e),  f|+,  <  m,  W{f)  =  u  +  x}dt 


intuitively  it  seems  clear  that  each  term  in  the  series  (4.5)  is  exponentially  smaller  than  its 
predecessor  and  hence  the  entire  series  is  exponentially  smaller  as  m  -»  oo  than  PgT^{P  < 


»'(«)  €  dx}  =  2exp(-2»jifh)(»7i  +  rii)dxlt^l^. 

Formally  substituting  these  expressions  into  the  right  hand  side  of  (4.2)  yields  as  an  upper 
bound  for  the  left  hand  side 

-  4*  d*  c  ip[(x  -  (t/m)/{t{l  - 

too  too 

Jo  Jo  ^{^0  <  m  -  t  -  e,  JF(f )  =  X  +  u} 

+  »(«)• 


A  straightforward  calculation  beginning  with  (say)  Theorem  3.42  of  [17]  shows  that 


W{t)  —  Mt>  u}.  In  this  notation  we  are  interested  in 

Abo  let  Tg  =  \D£{t  :W(t)  =  x}  and  define  irhyW{a)=  Mtam-  Finally  let 

ft  =  ft{x)  =  inf{s  :»>t,  W(»)  0  (x,  x  +  «)} 

and  It  =  sup{«  :  «  <  t  IF(«)  = 

Lemma  4.1. 

M^edx,  I, +.6(1,  (  +  .), 

ft+(  <  m,  W{f)  =  «  +  x}dt. 

Proof.  We  start  from  the  relation 

pff{T  <  m}  =  r  f  lim  <  m,  €  (t,«  +  c),  W(a)  €  dx}dt. 

It  may  be  shown  that  the  absolute  difference  between  this  integral  and  the  right  hand  side 
of  (4.1)  is  majorised  by  a  sum  of  terms,  each  of  which  as  a  consequence  of  Fatou’s  lemma 
is  less  than 

r  lim  sup  \W{si)  -  W(si)|  >  o}*, 

which  is  easily  seen  to  equal  0. 

To  obtain  an  upper  bound  for  (4.1),  we  omit  the  condition  T  >  t  and  rewrite  the  right 
hand  side  by  conditioning  on  W(t)  and  W{t  +  €)  to  obtain 

€  dx,  /|+«  €  (1, 1  +  e),  ft+t  <  m,  W(f)  =  u  +  *} 

=  >  t,  W(t)  6  dyi}Fj:7‘’{W(c)  e  dv2}  (4.2) 

e  <  m  - w(ro)  =  *  +  o}. 

In  (4.2)  each  of  the  first  three  factors  can  be  eraluated  explicitly  with  the  aid  of  (3.13)  of 
[17].  We  do  so  and  then  make  the  change  of  variables  p;  =  z  +  to  obtain  as  e  — »  0 

P„‘J{f.>*,  W(t)Gdvi} 

~  -2zqie<p((z  -  f«/m)/{t(l  -  t/m)}^/*|(/i7i/**^’(l  - 

Pj"^  *”‘^{JF(f)  €  ~  tp(qa  -  qi)d»ft, 
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This  quantity  can  be  calculated  numerically  (e.g.  [20],  Section  2.4)  or  approximately  as 
suggested  in  (1.8). 

Lemma  S.4. 


lim  n-»ir(Ao,n)  =  2(2f  -  fo)V[2(2f  -  fo)]/(f  -  ^o), 
where  v  is  defined  in  (3.2). 

Proof.  It  suffices  to  evaluate  the  limit  on  the  right  hand  side  of  (3.1).  By  the  definition  of 
Tg  and  Wald’s  likelihood  ratio  identity  (cf.  [20],  Theorem  1.1) 

P_i„{maxf;,-  >x}  =  P-^o{Tg  <  n}  =  i&^o[exp(-2;ior^r.);  T,  <  n] 

i<n 

=  exp(-2/io*)^,,oexp(-2/ioil,);  T,  <  n}. 

Hence  it  suffices  to  evaluate  the  limit  as  n  -*  oo  of 

n~^  [  E^„{exp{-2itoRg);  T,  <  n}dx.  (3.3) 

Jo 

We  split  this  integral  into  three  pieces,  0  <  x  <  (1  -e)n/io,  (1  -e)nfio  <  x  <  (l+e)n/io,  and 
(l  +  «)n/io  <  X  <  00.  Uniformly  for  x  <  (l-c)n^,  P^oiT,  <  n}  >  Ppo{Sn  >  (l-c)n^}  -» 
1,  so  by  (3.2)  the  limit  inferior  of  the  expression  in  (3.3)  exceeds 

r(l-()n|io 

liminfn~^  /  £fi,{exp(-2Mi^)}dx  >  (1  -  c)/io(^(2po)- 

Jo 

Fur  an  upper  bound,  we  use  the  obvious  inequalities  fi'|io{exp(— 2/ioi^);  2**  <  n}  < 
Ef,g{exp{-2noRg)}  or  P^oi^*  ^  according  as  x  <  (1  +  e)n/io  or  x  >  (1  +  e)n|io.  The 
range  x  <  (1  +  e)n/io  is  analysed  as  above;  and  for  x  >  (1  +  f  )nfio,  Pnir,  <  n>  is  botmded 
by  the  corresponding  probability  for  a  Brownian  motion  process.  Some  calculation  shows 
that  the  lim  sup  of  (3.3)  is  smaller  than  (1  +  e)itov(2fht).  Since  c  >  0  is  arbitrary,  this 
completes  the  proof. 

Proof  of  Theorem  2.  This  follows  immediately  from  Lemmas  3.3  and  3.4. 

4.  Proof  of  Theorem  S. 


Let  be  the  probability  measure  under  which  W(-)  is  a  Brownian  bridge  starting 
at  a  at  time  0  and  terminating  at  6  at  time  (.  Let  Mt  »  mino<«<i  W(s)  and  T  »  inf{t  : 


Proof.  This  is  proved  just  like  Lemma  2.3.  We  indicate  the  high  points.  Let 


It  can  be  shown  that  for  m  and  n  large 


The  main  contribution  to  the  sum  on  the  right  comes  from  a  neighborhood  of  those  k  and 
/  for  which  the  marginal  probability 


P{ZknJn  >  tt} 


is  a  maximum,  i.e.  from  a  neighborhood  of  In  —  kn  =  Aom,  where  Ao  =  f/(2(  -  (o)> 
Substituting  the  estimate  of  P(Bkj)  from  Lemma  3.2  and  analyzing  the  sum  as  in  Lemma 
2.3  gives  the  stated  result. 

Before  stating  Lemma  3.4  we  introduce  some  notation.  First  note  that  when  jb  ~  *o  = 
mAo  the  random  variables  Ui  and  Vi  from  Lemma  3.1  are  both  .M(-(2f  —  (o)>  1)>  and  the 
exponential  appearing  in  the  definition  of  ITfAo,  n)  is 

exp(*(f  -  Aofo)/Ao(l  -  Ao))  =  exp[2(2f  -  fo)*]. 


Let  Pf,  denote  the  probability  measure  which  gives  the  random  walks  Ui  and  Vj  increments 
having  a  N{n,  1)  distribution.  We  are  puticularly  interested  in  the  case  fio  =  —  Using 
this  notation  and  the  identity 


e^*P{X  >  z}dz  = 


-1). 


we  obtain 

lim  n~*J5r(Ao,n)  =  2(2f  -  (o)’(f  “ 

W  ’00 

•  lim  (n'*  /  exp(2/ioz)P-^o{™axU,'  >  x}dx 

Let  Tg  s  inf{n  :U„>  x)  and  Rg  a  Uy,  -  x.  It  follows  from  renewal  theory  that  for  ^>0, 
the  Pft  distributions  of  Rg  converge  weakly  as  z  -»  oo  (cf.  [20],  Theorem  2.3).  Let 


»/(m)  =  Urn  ^,i/2[«P(-Mi?.)I- 


(3.2) 


Let  W({t)  be  a  Brownian  bridge  starting  from  0  at  t  =  0  and  equal  to  (  at  t  =  m.  Let 
u  =  mf  and  (  =  mfo  for  some  fixed  f  >  0  and  fo  <  ?•  Let  Zij  =  Wf^j)  -  We  are 

interested  in 

P{  max  Zij  >  u}. 

Lemma  S.l.  Let  jb  -  to  =  mA  for  some  A  >  0.  Then  as  m  oo 


ijo— y  ~  u  +  X,  t,y  —  0,  •  •  • ,  n  I  "i*  Vji  •» y  0, 1,  •  •  • ,  n), 

where  Ui  and  Vj  are  partial  stuns  of  independent,  identically  distributed  random  variables 
with  Ui  ~  1)  and  Vi  ~  iV(-(f  -  fo)/(l  ~  A),  1).  The  convergence  is  uniform  for 

A  bounded  away  from  0  and  1. 

Proof.  Note  that 

~  ^ioJo  ~  ^•o-*.*o  ^io-iJof 

and  conditional  on  the  processes  t  =  !,•••,!»  and  Zj^-fj^,  j  — 

are  independent  of  each  other,  provided  m  is  sufficiently  large.  The  indicated  limitmg 

distributions  follow  from  Lemma  5.1  of  (20]. 

Lemma  S.2.  Let  jb  -  to  =  mA.  As  m  -*  oo 

«/>{  m«  >  «}/(>»A(l  -  A)|‘'V{(o  -  A{)/|mA(J  -  A)l‘'>)  -  1  +  H(A,  n), 

where 

JT(A,n)  =  f  f  P{maxff,  +  maxVy  >  x}exp((f  -  A(o)*/A(1  ~  A)]<f*/A(l  “  A). 

Jo  »■<*»  i<" 

and  the  convergence  is  uniform  for  A  bounded  away  from  0  and  1. 

Proof.  This  is  proved  exactly  like  Lemma  2.2. 

Lemma  S.S. 


lim  P{  max 
*00 


>  u}  exp(2mf (f  -  fo)](2f  -  ^o)*/nt(f  -  fo)’  =  n~*F(Ao,  n), 


where  Ao  =  f/(2f  -  Co)- 


uniformly  in  t  botmded  away  from  0. 

Proof.  This  follows  from  Corollary  3  of  [4].  Alternatively  it  can  be  proved  by  the  method 
of  Lemma  3.4  below,  which  yields  an  explicit  evaluation  of  ff*  in  terms  of  the  function  v 
defined  in  (3.2).  The  proof  is  completed  by  the  observation  that  v{/t)  -*  0  it  -*  0. 

Lemma  2.5.  Let  7  =  for  some  0  <  ^  <  1/2.  Then  as  u  -»  00 

P{  max  Wo{iq,jq)  <u-  7«“*.  W^o{*.0  >  u)  =  o[u*exp(-2o*)]. 

Proof.  See  Lemma  12.1.5  of  [11]. 

Lemma  2.8.  With  the  same  notation  as  above 

P{u  -  7/0  <  max  IFo(tg,yg)  <  tt}/tt*exp(-2u*) -»(«*■’- 1)  /  H*{t,a)dt/ta^. 
0<iqJi<i  Jifi 

Proof.  This  follows  exactly  as  in  Lemma  12.2.6  of  [11] . 

Proof  of  Theorem  1.  Let  e  >  0.  Choose  ^  |  and  a  >  0  so  that  for  all  |  <  t  <  1 

|a"*fr(t,  a)  -  32]  <  €  and  e*''  -  1  <  e. 


Then 

jo”*  f  H*{t,a)dtft  -  3210^2]  <  2e, 

Jl/2 

and  by  Lemmas  2.5, 2.6, 

lim  jPl  max  Wo(fg,  jg)  >  0}  —  P{  sup  Wo(s,t)  >  u}[/u*exp(-2u*)  <  5«, 
while  by  Lemma  2.4 


P{  max  Wo(*?,yg)  >  0}  ~  (4log2)u*exp(-2u*). 

0<ifj9<l 

S.  Proof  of  Theorem  2. 


For  the  most  part  the  proof  given  here  for  Theorem  2  is  very  similar  to  that  of  Theorem 
1.  The  main  difference  relates  to  the  discrete  indexing  set.  See  Lemma  3.4.  Lemma  3.1  could 
be  proved  by  calculation  of  means  and  covariances  along  the  lines  of  Lemma  2.1,  but  we 
give  a  proof  which  can  be  generalized  to  (nonnormal)  exponential  families  of  distributions. 
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Fix  t  =  (i+  l)nq  >  1/2.  According  to  Lemma  2.2  P(Bkj)  is  asymptotically  of  the  form 
VpfB  \  ^[1*  +  l)nq,  t,  u]{l  -f-  ffl(k  +  l)nq,  t,  n,  a]} 

V  ~  *  “/((*  +  ~ 

The  function  considered  as  a  function  of  *  has  a  unique  maximum  at  s  =  l/2t. 

Let  io  he  such  that  |l/2t-(Jfco  +  l)nq|  =  inf*  |l/2t— (jb  +  l)n7|.  Set  +  =  l/tt  +  triq, 

where  |c|  <  1,  and  set  *  =  4  -  Ao  +  1-  Then 

Pin  i  ~  *"*l^"*®  +  l/2t  +  eng, t, «il{l  -f  g{tnq  -e  l/2t  +  eng,  t, n, a)} 

"  ***  u/(t(tn7  +  l/2t  +  en7)(l  -  t(inq  +  l/2t  +  enq))]*/* 

To  simplify  this  expression,  note  that  the  sum  concentrates  in  a  neighborhood  of  i  =  0; 
and  since  the  function  ff  as  well  as  the  denominator  are  continuous  functions,  they  can  be 
replaced  by  their  values  at  t  =  0.  Since  g  — *  0  as  u  — »  oo,  this  yields 

S  P(Btj)  ~  '"*1^  %(.»«  + 1/21 +  <»,,(,»).  (2.2) 

it  $^“40 

The  sum  in  (2.2)  is  easily  approximated  by  the  integral 

/oo 

exp{-Sz^)dz(nqtu  =  exp(-2u*)/4iigtu. 

■OO 

Substituting  this  into  (2.2)  yields 

^PiBkj)  ~  (1  +  ff(l/2«,t,n,a)]exp(-2u’)/8ngeu*. 

* 

The  case  (/  +  l)ng  <  |  can  be  done  similarly  and  is  seen  to  be  of  a  smaller  order  of 
magnitude.  Therefore 

E  p(Bw)  ~  E 

~  (8n*g*u’)“^  exp(-2u’)  /  {1  +  H{l/2t,  t,  n,  a)}dtft 

Jl/7 

=  8“*u*exp(-2u^)  f  {1  +  H(l/2t,t,r»,o)}(ft/t(no)*. 

Jl(2 

The  proof  is  completed  by  letting  n  -*  oo  and  proceeding  as  in  Lemma  12.2.4  of  (11). 


Lemina  2.4.  Az  a-*  0 


a-^H*{t,a)-*32 
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Lemma  2.2.  For  6xed  n  and  a,  as  u  -»  oo 

P{  Woia-iq,t-3q)  >  -»  1  +  J?(s,  t,  n,  a), 

where  the  convergence  is  uniform  for  at  bounded  away  from  0  and  1,  and 

ir(s,t,n,a)  =  /  P{maxl7,  + maxVy  >  2}exp[z/sf(l  -  st)]dz/st(l  —  at), 

Jo 

where  Ui  and  Vj  are  partial  sums  of  independent,  identically  distributed  random  variables 


Vi  ~  Ni-a/a,  at),  Vj  ~  N(-a/t,  as). 

Proof.  The  argument  is  the  sam.  as  Lemma  12.2.3  of  [11]  used  in  conjunction  with  the 
representation  (2.1)  of  the  limiting  process. 

Lemma  2.S.  There  exists  a  function  ir*(t,  a)  such  that  limn~>oon~^i7(l/2t,t,n,a)  = 
H*{t,a)  uniformly  in  t  bounded  away  from  0.  As  u  oo 

P{  max  W'b(w,J?)  >  «}/«*exp(-2u*) -♦  /  H*{t,a)dt/t. 

0<K4r<l  Ji/i 

Proof.  Recall  that  the  major  contribution  to  the  indicated  probability  is  expected  to  come 
from  a  neighborhood  of  at  s  1/2,  where  E[WQ{a,t)\^  is  a  maximum. 


=  {.  ^  Wo(%q,jq)  >  u}. 

*»<»<(*  +  l)n 

M  <  y  <  (/  +  l)n 

For  technical  convenience  we  asstune  that  q  is  such  that  (nq)~^  is  an  integer.  Then 


so  the  probability  of  interest  is  sandwiched  between 

E  nBkjnBu.,r} 


E '■(»«)• 

hj 
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